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Abstract. In this paper we address sampling and approximation of functions 
on combinatorial graphs. We develop filtering on graphs by using Schrodingcr's 
group of operators generated by combinatorial Laplace operator. Then we 
construct a sampling theory by proving Poincare and Plancherel-Polya-type 
inequalities for functions on graphs. These results lead to a theory of sparse 
approximations on graphs and have potential applications to filtering, denois- 
ing, data dimension reduction, image processing, image compression, computer 
graphics, visualization and learning theory. 
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1. Introduction 

During the last years harmonic analysis on combinatorial graphs attracted con- 
siderable attention. The interest is stimulated in part by multiple existing and 
potential applications of analysis on graphs to information theory, signal analysis, 
image processing, computer sciences, learning theory, astronomy [2], [3J, [S]-[S], 

M- EI- E0 m- 

Some of the approaches to large data sets or images consider them as graphs. 
However, for hyperspectral images, for example, this leads to graphs with too many 
vertices imbedded into high dimensional spaces, thus making dimension reduction 
necessary for effective data mining. 

It seems that one possible way to approach this problem is by using ideas from the 
classical sampling theory which has already proved very fruitful in various branches 
of applied mathematics. 

Let us remind the Classical Shannon-Nyquist sampling Theorem. It states that 
for all Paley- Wiener functions of a fixed bandwidth defined on Euclidean space 
one can find "not very dense" sampling sets which can be used to represent all 
relevant Paley- Wiener functions. In some sense it allows to reduce the set of all 
points of Euclidean space to a countable set of points. Moreover, since the set of 
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all Paley- Wiener functions is dense in the space L2(R d ) one can use this property 
to approach sampling of non-Paley- Wiener functions. 

The goal of this work, to show that analysis of lower frequencies on a graph can 
be performed on a smaller subgraph. Note that in many situations lower frequencies 
are more informative while higher frequencies are usually associated with noise. 

Let us consider an example. Suppose that a data set is presented by 10 6 points. 
One way of data mining [2], [3] is to convert the data set to a graph and develop 
harmonic analysis associated with a corresponding combinatorial Laplace operator. 
Let us assume for the simplicity that we identify our data set with the path graph 
Z 10 e of 10 6 vertices. We measure frequency on this graph in terms of the eigenvalues 
of the corresponding Laplace operator on Z 10 6 whose definition is given in section 
4. It has 10 6 eigenvalues (frequencies) which all belong to the interval [0, 4] and are 
given by the formula 



Our results show, that if one will delete every second point from Z 10 e then the 
resulting set will be a uniqueness set and even a sampling set (see definitions bellow) 
for all functions on Z 10 e which are linear combinations of the (about) 12 x 10 4 first 
eigenfunctions. If one will delete about 2/3 of all points then the resulting set 
is a sampling set for all functions on Z 10 6 which are linear combinations of the 
(about) 6 x 10 4 first eigenfunctions. By extending our reasoning it is possible 
to show that about 10 percent of "uniformly distributed" points of Z 10 e form a 
sampling set for functions on Z 10 e which are linear combinations of the about 500 
first eigenfunctions. 

Thus by applying an appropriate filtering to a function on a graph, i.e. by 
removing high frequencies we not only remove noise but we also reduce analysis on 
a whole graph to analysis on a much smaller subgraph without loosing many of the 
lower frequencies. We also give estimates of possible losses of information which 
can occur after filtering. 

In order to construct a sampling theory on combinatorial graphs we prove certain 
analogs of Poincare inequality on graphs. Our Poincare inequalities in the Section 
2 provide estimates of the norm of a function in terms of its " derivatives" . 

In what follows we introduce few basic notions and formulate and discuss one 
of our Poincare inequalities. We consider finite or infinite and in the later case 
countable connected graphs G = (V(G),E(G)), where V(G) is its set of vertices 
and E{G) is its set of edges. We consider only simple (no loops, no multiple edges) 
undirected unweighted graphs. A number of vertices adjacent to a vertex v is called 
the degree of v and denoted by d(v). We assume that all vertices have finite degrees 
but we do not assume that the set of degrees of all vertices {d(v)} veV , G \ is bounded. 

The space L<2(G) is the Hilbert space of all complex- valued functions / : V(G) —> 
C with the following inner product 



2 - 2 cos 



10 6 - 1' 



k = 



0,1, ...,10 6 - 1. 



(/,<?) 



E /(«)*(«) 



v£V(G) 



and the following norm 
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By the adjacency matrix A of G we understand a matrix with entries {a uv }, 
V(G), where a uv — 1, if vertices u and v are adjacent, and a uv = otherwise. 

Let A be the adjacency matrix of G and D be a diagonal matrix whose entree 
on main diagonal are degrees of the corresponding vertices. Then we consider the 
following version of the discrete Laplace operator on G 

(1.1) L = D — A, 
or explicitly 

Lf(v) = J2(f(v)-.f(u))JeL 2 (G), 

where notation u ~ v means that u and v are adjacent vertices. Note that this 
operator is different from the normalized Laplace operator C is defined in [B] and 
which was considered in our previous papers |20|- |22j . 

The Laplace operator L is self-adjoint and positive definite in the space L 2 (G). 
Moreover, if degrees of all vertices are uniformly bounded 

(1.2) D(G) = max d(v) < oo 

vGV(G) 

then the operator L is bounded and its spectrum a(L) is a subset of the interval 
[0,2D(G)}. Note, that for the normalized version of the Laplace operator C the 
spectrum is always a subset of [0, 2]. 

Given a proper subset of vertices S C V(G) its vertex boundary bS is the set of 
all vertices in V(G) which are not in S but adjacent to a vertex in S 

bS = {v £ V(G)\S : 3{u, v} G E{G), u e S} . 

If a graph G — (V(G),E(G)) is connected and S is a proper subset of V then 
the vertex boundary bS is not empty. 
We will also use the following notation 

(1.3) D(S) =m&xd(v),S CV(G). 

To illustrate our Poincare inequalities let us formulate and discuss a particular 
case of a more general inequality proved in the Theorems 12.11 and 12.31 The follow- 
ing inequality gives an estimate of the norm of a function trough its "first order 
derivatives" and in this sense it can be considered as a global Poincare inequality. 

Theorem 1.1. If S is a subset of vertices such that every vertex v in bS is connected 
to at least Ka — Kq(S) vertices in S and 

(1.4) S = S U bS = V(G), 
then the following inequality holds for all f G L^iGf) 

(1.5) ii/n < |e + 1) I/mi 2 } 172 + ^ \\ Li,2 f 

where rfo( u ) ; u € S, is the number of vertices in bS adjacent to u € S. 

Example 1. Suppose that G is a star {vq,vi, ...,vn} whose center is Vq. Let S be 
the vertex {^o}. Then K = l,d (v ) = N, and (II. 5[) becomes 

H/ll < V2N+l\f(v Q )\ +2||L 1 /a / ||. 
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In particular, if f(vj) = 1 for all < j < N then ||/|| = VN+l, ||L 1/2 /ll = 0, and 
(jl.5|) becomes 

VN + 1 < V2N+1. 

Example 2. For the same star graph as above we consider S — {vi, vn}, then 
Kq(S) = N,do(vo) = 1, and for any N the inequality (|1.5|) becomes 



In particular, if we consider function / such that / (i>o) = and f(vj) = 1 for all 
other j = 1, 2, .., JV, then ||/|| = VN, ||i 1/2 /|| = V^, and for any iV the inequality 
(|1.5|) becomes 

For the function / which is identical one, we obtain 



Example 3. Let Cn be a cycle of N vertices {vi, ujv}. Take another vertex 
and make a graph Cn U {«o} by connecting «o to each of v\, d^v- 

Let Xk(N) be a non-zero eigenvalue of the operator L on the graph Cn and let 
ifk be a corresponding orthonormal eigenfunction. Construct a function tpi- on the 
graph Cjy U {«o} such that <fik(v) = <Pk(v) if u G Cn and ^fe(fo) = 0. Since is 
orthogonal to the constant function 1 we have that 



Let S be the graph Cn — Viv}- In this case the boundary of S is the point 

^o, Kq = N, do(vj) = 1 and then for the function (p^ the inequality () 1 . 5[) takes the 
following form 



Since for k — 1 the eigenvalue Ai(iV) goes to zero when N goes to infinity, we see 
that the right-hand side of the last inequality can be made arbitrary close to one. 

For any k = 1, N one has the estimate Afc(iV) < 27V and for the corresponding 
ipk it gives the inequality 




VN + 1 < VN + 2. 



^{vj) = 




(\ k (N) + lMvj). 



1/2 
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According to our definition of Paley- Wiener functions (see Section 3, and also 
[IB]- [20]) they always satisfy the Bernstein inequality and together with Poincare 
inequality it leads to Plancherel-Polya inequalities on graphs. 

Our Poincare-Polya-type inequalities (Theorem !3-3[) give two-sided estimate of 
the norm of an appropriate Paley- Wiener function in terms of its values on a subset 
of vertices. We use these estimates to apply classical ideas of Duffin and Schaeffer 
9 about Hilbert frames to obtain the sampling Theorem 13.41 which is one of the 
main results of the paper. In particular we obtain a formula which represents 
Paley- Wiener functions in terms of their values on specific subgraphs. We call 
them sparse representations of Paley- Wiener function. 

In Section 4 we construct a filtering operator (Theorem l4.1|) using Schrodinger's 
one-parameter group of operators generated by a self-adjoint positive definite op- 
erator L in the Hilbert space L,2(G). This filtering operator maps entire Hilbert 
space L2{G) into appropriate Paley- Wiener space. We also prove our version of the 
Direct Approximation Theorem using a modulus of continuity expressed in terms 
of the Schrodinger group of operators generated by L (Theorem l4.3j) . By combining 
filtering procedure with our sampling theory, we obtain sparse approximations 
to functions in L2(G). 

We would like to emphasize that the sampling theory that is developed in the 
present article is different from the one we had developed in [2D], [2T], [22], [23]. 
We also have to mention that our approach to sampling on graphs is very different 
from methods which were presented and explored in [10], [11], [14]. Note, that our 
approximation theory on graphs is a generalization of the classical approximation 
theory by Paley- Wiener functions p], [16]. It also has to be mentioned that some 
ideas about approximation theory on compact metric spaces (which include finite 
graphs) were introduced in [13] . Basic ideas of harmonic analysis on graphs that 
are relevant to our paper were recently summarized in the book |15] . 

Our results can have applications to filtering, denoising, approximation and com- 
pression of functions on graphs. These tasks are of central importance to data di- 
mension reduction, image processing, computer graphics, visualization and learning 
theory. 



2. Poincare inequalities on combinatorial graphs 

For a function / G -^(G) we introduce a measure of smoothness which is the 
norm of a "gradient" 

(2-1) l|V/f = £|/(«)-/(u)| 2 , 

where the sum is taken over all unordered pairsjw, u} for which v and u are adjacent. 
Given a subset W C V we will use the notation 

(2.2) \m\\w= E \m-f(u)\ 2 . 

For any S which is a subset of vertices of G we introduce the following operator 

(2.3) cl°(S) = S, cl{S) = SUbS, d m (S) = cl (c/ 7 ™" 1 (S)) , m e N, S C V(G). 
We will use the following notion of the relative degree. 
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Definition 1. For a vertex v £ d m (S) we introduce the relative degree d m (v) as 
the number of vertices in the boundary b (cl m (S)) which are adjacent to v. 

d m (v) = card{w G b(d m (S)) : w ~ v} . 

For any S C V(G) we introduce the following notation 

D m = D rn (S) = sup d m (v). 

Definition 2. For a vertex v e b (cl m (S)) we introduce the quantity k m {v) as the 
number of vertices in the set cl m {S) which are adjacent to v: 

k rn (v) = card{w e d m (S) : w ~ u} . 

For any 5 C V^(G) we introduce the following notation 

K TO = /f m (5) = inf k m (v). 

For a given set S C ^(G) and a fixed n e N consider a sequence of closures 

S, d(S),...,d n (S),ne N. 

Theorem 2.1. In the same notations as above, if S is a subset of vertices such 
that the boundary of d n (S),n € N, is not empty then the following inequality 
holds 

2 (§in(f+0)'V/, 

In particular, if 

(2.5) cl n (S) = V{G), 

then 

(^) 2 i;Vn 1 fl+ 1 ) ii^vii- 



j=0 J i=j+l v 



Proof. First, we are going to prove, that for any subset S of vertices for which the 
boundary of cl n ~ 1 (S), n e N, is not empty the following inequality holds 

e i/K)i 2 <n(^+i) ei/m 2 + 

w„ed"(s) i=o ^ 1 ' w es 

9 71-1 /on \ Ko(5) 

f-n e e i/m-/k„m)i 2 + 

i=l V * ' «oG6S io = l 
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J-nff^ + i) E E i/(«o -/(«i 1 («i))i a + . 

i=2 V 4 7 wi€6(cJ(S)) ji = l 



(2.7) — X! E l/K-O-ZKn-^n-i))! 2 , 

" 1 ^n-iefeCc;"- 1 ) j'„-i=i 

where for every < m < n — 1 the Uj m (v m ) is a vertex in cl m (S) which is adjacent 
to v m e 6(c/ m (5)). 

For any two vertices v, u € F one has 

(2-8) f(v) = f(u) + (f(v)-f(u)) 

and 

(2-9) |/(«)| 2 <2(|/( U )| 2 + |/( W )-/( U )| 2 ). 

Let v £ bS and Wi(w), Uk (v) £ 5 be some of the K vertices in S which are 
adjacent to v. For each of them the following inequality holds 

(2.10) |/H| 2 < 2 (\f( Uj (v))\ 2 + \f(v) f( Uj (v))\ 2 ) ,l<j< K , 

which implies the inequality 

(2.H) I/mi 2 < — i/KW)i 2 + 7T E - /KW)i 2 ' 

Since every Uj(u) € 5, 1 < j < K 0} can be adjacent to a maximum of do(uj(v)) 
distinct vertices v € bS, the previous inequality implies 

E i/wi 2 ^ 

vebs 

E|- E i/kh)i 2 +E|- E i/w-/kw)i 2 < 

(2.12) e ^i/ni 2 + E ^ E - 

Thus, 

(2.13) £ i/mi 2 <E^i/wi 2 + E|-E i/w-/KW)i 2 . 

t>6bS u£S j=l v£bS 

where m(v), ...,uk are different vertices from S that adjacent to v. The last 
inequality implies the following 

on K ° 9 

(2.14) £ i/(,)i 2 < £ ^i/wi 2 + E ]f E - /(%(-))i 2 - 

By adding this inequality with the identity 

E i/(«)i 2 = E i/(")i 2 . 
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one obtains the inequality which holds true for any subset of vertices S: 

E i/K)i 2 <f^ + i) E i/(-o)i 2 + 



V K 

w!eci{s) v 7 w es 

2 K ° 

(2.15) — E El/M-/M w °))l 2 > 

V £bSj=l 

where ui(vo), uk G S are different and adjacent to v. 

Since cl 2 (S) — cl(cl(S)) the inequality @ implies the following one 



E i/(^)i 2 <(f^ + i) E i/(^)i 2 + 

w 2 ed 2 (S) ^ 1 ' Wl £cl(S) 

(2.i6) J- e Ei/w-/KW)i 2 - 

1 «iefc(ci(S))ii=i 
where ^(ui) G cl(S). Along with the @ it gives 

E « 2 <(f+ 1 )(f + 1 )Ei/wi 2 + 
1 f2D] 1 E Ei/^)-/kn)i 2 + 



vo&bS jo = l 



(2.i7) J- e Ei/^)-/(^(^))i 2 ' 

1 «iefe(ci(S))ii=i 

where ^(ui) G cl(S),Uj (vo) € 5 are different vertices that adjacent to v. 

The derivation of ([2]) shows that by induction one can prove the inequality ([2]). 

Next, let us remind, that just by construction the vertices v m € b(cl m (S)) and 
Uj m (v m ) £ cl m (S) are adjacent and 

m ) 7 

if fci 7^ fc2. It is also clear that v m £ b(cl m (S)) is different from any of Vk € 
b (cl h (S)) as long asm ^ k. Because if this the inequality ([2]) implies the inequality 



/n-l 



1/2 , v 1/2 



2 



1/2 

j=o •> i=j+i v 4 7 y 

To prove the Theorem we are going to show that 

(2-19) ||V/|| = ^||L 1/2 /l|. 

Indeed, 
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nv/f=x; 1/00-/(1 

E i/(«)i 2 d(«) + E i/(«)i 2d w - 2 E /m/w 



wev «ev 



2 Ei/mM")-E/w/w 



vuev 



(2.20) 2 «£>/, /) - (A/, /)) = 2 (L/, /) = 2 (l 1 / 2 /, L 1 / 2 /) = 2||L 1/2 /|| 
The inequalities ((5J) and @ imply (12.11) . The Theorem is proved. 

The formula (|2.13j) gives the following Corollary. 



□ 



Corollary 2.1. If S is a subset of vertices such that every vertex v in bS is 
connected to at least Ko(S) vertices in S, where 1 < Ko(S) < d(v) then for all 

f G L a (GO 
(2.21) 

If in addition 
(2.22) cl(S) = SUbS = V(G), 

then the following inequality holds for all f £ L2 (G) 

L 1/2 / 



i/h{e 



^■^.) 11/11 - o;i'S@+i)i/(«)i 9 > 



#o(S) / v J 



Since Kq(S) > 1 we have the following. 

Corollary 2.2. 7/5 is a subset of vertices such that the condition \2. 22}) holds 
then the following inequality takes place 

(2-24) 11/11 < |E ( 2d o( u ) + 1) l/MI 2 ) + 2||L 1/2 /||. 

lues J 

To extend our results to higher powers of L we will need the following Lemma 

Lemma 2.2. If for some positive c > 0, a > 0,s > 0, and an (p € L2(G) the 
following inequality holds true 

(2.25) \\ip\\ < a + c\\L s <p\\, 
then for the same c, a, s, <£> the following holds 

(2.26) ||</>|| < 2ra + 8 r - 1 c r \\L rs tp\\ 
for all r = 2 l ,l = 0, 1, ... . 

An application of the Lemma l2~2l gives the following result. 



10 



SAMPLING, FILTERING AND APPROXIMATION ON GRAPHS 



Theorem 2.3. If the assumption 112. 5\) is satisfied, then for any r = 2 , / = 0, 1, 

the next inequality holds 



'n-l 



1/2 , x 1/2 



r/2 

' n— 1 n— 1 x 



2 



(2.27) 2— E * J] + ll^'Vll 



v i=o J i=i+i 

Theorem 2.4. J/S" is a subset of vertices such that every vertexv in bS is connected 
to at least Kq vertices in S , where 1 < Kq < <j(u) and the condition \2. 22\) holds, 
then for any r = 2', I = 0, 1, 

(2.28) ll/H < 2rJ 2 -^ + 1 (E l/HI 2 ) ' + 2 -^\\L r/2 fl 

v \u£S ) Kq 

Proof. According to the previous Theorem the assumptions of the Theorem give 
the inequality 

1/2 



(2.29) H/ll <^+l (E l/(«)l 2 ) 



+ 4^ 1/2 /l|. 



Now an application of f|2 .26[) gives the result. 

□ 

Corollary 2.3. If S is a subset of vertices such that \2.22\l holds, then for any 
r = 2 , / = 0, 1, the following holds 

(2.30) ll/H <2r72^Tl(E l/WI 2 ) + 2^\\U^f\\. 



3. PLANCHEREL-POLYA INEQUALITIES, SAMPLING AND SPARSE 
REPRESENTATIONS OF PALEY-WlENER FUNCTIONS 

By the spectral theory of self-adjoint operators [I], there exist a direct integral 
of Hilbert spaces A = J A(X)dm(X) and a unitary operator Tl from I/2(G) onto A, 
which transforms the domain T> s , s > 0, of the operator L s onto A s = {a E A\\ s a £ 
A} with norm 

/ poo \ 1/2 

(3.1) ||o(A)|U. = U ^ s \HX)\\ 2 AW dm(\)j 

andJ t (L/)=A(J i /),/eDi. 

Definition 3. The unitary operator Tl will be called the Spectral Fourier trans- 
form and a = Thf will be called the Spectral Fourier transform of / € L^iG). 



Definition 4. We will say that a function / in Li(G) belongs to the space PW^iV) 
if its Spectral Fourier transform T^f = a has support in [0,w]. 
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The following theorem describes some basic properties of Paley- Wiener vectors 
and show that they share similar properties to those of the classical Paley- Wiener 
functions. The proof of these and many other properties of Paley- Wiener vectors 
can be found in our other papers and in particular in [18] - [21] . 

Theorem 3.1. The following conditions are equivalent: 

1) The linear set Ui i ,>o^ w (-^) * s dense in L2{G). 

2) The set PW U (L) is a linear closed subspace in Li2(G). 

3) A function f belongs to a space PWuj(L) if and only if for all k 6 N, the 
following Bernstein inequality holds true 

(3-2) l|£*/ll<« fc ll/ll; 

To obtain a Sampling Theorem for Paley- Wiener functions on graphs we have to 
establish Plancherel-Polya-type inequalities. The inequalities (|2.1[) and p. 21) along 
with the obvious inequality 

(3.3) (ei/hi 2 ) ^ii/ii 

imply the following Plancherel-Polya-type inequalities for functions in PW U (L). 
Theorem 3.2. In the same notations as in the Theorem \2.1[ if the condition 

(3.4) cl n (S) = V(G) 
and the inequality 

(3 - 5) w< 4^n^ 

\3=0 3 i=j+l v 

hold, then for any f € PW U {L) the next inequality takes place 

sH " 2 & 11/11 ^(n(f +i )) 1,2 te"<«»'f ■ 





n-1 



1/2 



(3-7) 1 + <1 



v j=0 3 i=j+l 

In particular we have the following Theorem. 

Theorem 3.3. If S is a subset of vertices such that every vertex v in bS is adjacent 
to at least K$ vertices in S, every v € S is adjacent to at most Dq vertices in bS 
and the condition 

(3.8) S = SUbS = V(G), 
along with the inequality 

(3.9) u < ^ 

4 
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hold, then 

(3.io) [ ^ |/(.)| 2 ) 1 < ii/n < i^/^ + i (E l/MI 2 ) ' • 



w/iere / € PW^L) and 7 = 2y/us/K < 1. 

The significance of the inequalities (|3.10j) is that they give two-sided estimate of 
the norm ||/|| of a Paley- Wiener function / in terms of its values on a smaller set 
ScV(G). 

Let P u be the orthogonal projector 

P» ■ L 2 (G) -> PW U (L). 

The last inequality (|3 . 10|) shows that the set of functions P u (S u ),u £ S, where 8 U 
is the Dirac measure concentrated at u £ S, is a Hilbert frame in the Hilbert space 
PW U {L) when u < ^. 

Thus, by applying the classical result of Duffin and Schaefier [9] about dual 
frames we obtain the following uniqueness and reconstruction Theorem. For the 
sake of simplicity we formulate it just for particular situation that satisfies (|3.8[) . 



Theorem 3.4. If S is a subset of vertices such that every vertexv in bS is connected 
to at least Kq vertices in S, where 1 < Kq < d(v) and the condition 

(3.11) S = SUbS = V(G), 

along with 

hold, then 

1) the set S is a uniqueness set for functions in PW U (L); 

2) there exist functions O u £ PW U (L), u £ S, such that for all f £ PW U {L) the 
following reconstruction formula holds 



(3.12) / = 



ues 



The last formula (|3.12[) is what we call a sparse representation since it rep- 
resents a function through its values on a subgraph. 

Remark 1. It is clear that if the spectrum the Laplace operator of a graph G is 
very close to zero then there are many subsets S of G and functions on G for which 
the last two Theorems convey non-trivial information. Thus, in the section bellow 
we discuss the situation on the infinite graph Z n . 

However, in the case of a finite graph G the spectral resolution is just the 
eigenvalue- eigenf unction representation and if Kq/A is less than the first strictly 
positive eigenvalue of L, then the assumption uj < Kq/4 would satisfy only for 
constant functions on G and the above inequalities would be trivial. 

But there are many finite graphs for which the Theorems 3.3 and 3.4 are not 
trivial for a "right" choice of subsets S C V(G). For example, take the cycle C n 
of n vertices for which the eigenvalues of the corresponding Laplace operator are 
2 — 2 cos 2^ . For a large n there many eigenvalues which are very close to zero. 
On the other hand there are sets S of "isolated" points in C n for which the number 
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Kq is either 1 or 2. Thus, the previous Theorems hold true for any of such sets of 
points for functions from PW U (G) , for which either uj < 1/4 or uj < 2/4. 

4. Filtering and Direct Approximation Theorem by Paley- Wiener 

functions on graphs 

The goal of the section is to describe relations between Schrodinger's Semigroup 
e ltL and the functional 

E(f,u>) = inf ||/-.g||, 

g£PW^(L) 

which measures a best approximation of / € LiiG) by functions from the Paley- 
Wiener space PWu>(L),ui > 0. If f u is the orthogonal projection of / on PWuj(L), 
then according to (|3. 1|) one has the following relation 

/ roc \ 1/2 

(4.1) £?(/,«) = ||/ - fj = (J ||a:(r)||^ (r) dm(r)J , 

where x(r) — Tf is the Spectral Fourier transform of /. In other words the best 
approximation E(f,uj) shows the "rate of decay" of the Spectral Fourier transform 
Tf of /. The same formula (13.11) implies the following inequality 



E{f,u) = \\f-fJ\\ - (J^ Mr)\\ 2 x{r) dm(r^j 



oo \ 1/2 



1/2 

< 



(4.2) c-JJf 7 -"|| a: (r)||i (r) dm(r)j = c,- s ||L s /||, s > 0, 

for all functions in L,2(G). 

The quantity ||L S /||, s > 0, is a measure of smoothness of a function /. In this 
sense the estimate (0]) generalizes the well-known fact of the classical harmonic 
analysis that the rate of approximation of a function by Paley- Wiener functions 
depends on the smoothness of this function. 

For any / € Li (G) we introduce a difference operator of order to G N as 

m 

Kf = £(-ir +J 'c4e iisi /, 

3=0 

where is the number of combinations from m elements taking j at a time. The 
modulus of continuity is defined as 

n m (f,s)= sup ||a;'7I|. 

In the following Theorem we construct a filtering operator which maps H into a 
Paley- Wiener space. 

Theorem 4.1. If h G Li(M) is an entire function of exponential type uj then for 
any f G L2{G) the function 

/oo 
h{t)e itL fdt 
-OO 

belongs to PW W {L). 
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Proof. If g = Q^(/) then for every real r we have 

/oc 
h{t-r)e ltL fdt. 
-OO 

Using this formula we can extend the abstract function e irL g to the complex plane 
as 

/"CO 

zL „ I ? / j \ iiL 



AtL 

e 5 



e l ^ 5 = / h{t- z)e lth fdt. 

J — OO 

Since by assumption /i £ Li(R) is an entire function of exponential type cu we have 

o 

and the i 1 (R)-Bernstein inequality implies the following 

/OO 
\h(t)\dt. 
-OO 

Thus, we obtain the following inequality 

pOO pOC 

\W zL g\\<\\f\\ \h(t-z)\dt<\\f\\e^ \h(t)\dt. 



It shows that for every function g* £ L2(G) the function (e lzL g,g*) is an entire 
function and 

/>oo 

\(e izL g,g*)\<\\g*\\\\f\\e»W / \h{t)\dt. 



In other words the (e lzL g : g*\ is an entire function of the exponential type to which 
is bounded on the real line and an application of the classical Bernstein theorem 
gives the inequality 

k 

<Lo k sn V \{e UL g l9 *)\ 



Since 



(I) <T*r> 



we obtain for t = 

/OO 
|fc(r)|dr. 
-OO 

Choosing g* such that ||<?*|| = 1 and (L k g,g*^ = ||£ fc <7|| we obtain the inequality 

/OO 
\h(r)\dr = C h uj k \\f\\, 
-OO 

where 

pOO 

C h = / \h(r)\dr. 



Now we make an important observation that regardless of the value of Ch the 
inequality (|4.3[) implies that g belongs to PW U (L). Indeed, for any complex number 
z we have 
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W zL g[ 



^ k z k L k g)/k\ 



k=0 



<C h \\f\\J2\z\ k u k /k\ = C h \\f\\e 



\z\ui 



k=0 



It implies that for any g* G L,2(G) the scalar function < e lzL g,g* > is an entire 
function of exponential type ui which is bounded on the real axis R 1 by the constant 
||.g*|| Hffll- An application of the Bernstein inequality gives 



|| < e L g,g > \\ C (r^ 
The last one gives for t = 



Jt \ <e«W> 



\<L k g,g* >\<u k \\g*\\\\g\\. 

Choosing g* such that \\g*\\ = 1 and < L k g,g* >= \\L k g\\ we obtain the inequality 
||L fc g| < w fe ||g||, k G N. The Lemma is proved. 

□ 

We will also need the following Lemma. 
Lemma 4.2. The following inequalities hold for all f G Li2(G) 
(4.4) £l m (f,s) < s k Q m -k(L k f,s), 0<k<m, 



(4.5) 



n m (f,ns) <n m n m (f,s), n,meN. 



Proof. The following identity holds 

(e ltL -I)f = i f e lTL LfdT, 
Jo 

where / is the identity operator. Iterations of this formula give the identity 

(e«i_j) fc / = i * f ... f e^ Tl+ - +r ^ L L k fdT 1 ...dT k , 
Jo Jo 

which implies (4.4). 

The second one follows from the property 

fii (/,*i + a 2 )<fii (/,*i) + fii(/,*2), 
which is easy to verify. 

Bellow the following function will be used 
(4.6) h(t) = a( S[n{t/n) y 

where n is a fixed even integer and 



(4.7) 



sin(t/n) 
t 



dt 



□ 



Now we construct another filtering operator 
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Vt m : La (GQ -> iW w (L), 

which is defined as 

(4.8) K' m (f)= l°° h(t){(-ir^AT/J + f}dt, 

J — OO 

where 

m m 

(4.9) (-l)" l+1 Ar/ = ^(-l)^ 1 ^^'^/ - ^ 6 je »''^/ - /, 

j=o J=l 

and 

(4.10) 6l+&2 + ... + 6m = l. 

The next Theorem is an analog of the classical Direct Approximation Theorem by 
entire functions of exponential type. 

Theorem 4.3. Let h be the function defined in {4.6]) and {4.7]) and the operator 
■p^ 1 ' 1 ™ is defined in {4-8]) - fT-lQ]) - We also assume that the following inequality holds 

(4.11) n>m + 2. 

For any appropriate n £ N and m £ N that satisfy {4-H]) a nd for every natural k 
such that 

< k < m, k,m £ N, 

there exists a constant m > such that for all 10 > and all f £ L/2(G) the 
following inequalities holds 

(4.12) E(f, U ) < \\K' m (f) ~ /II < V") - 

Ct fc = / h(t)\t\ k (l + \t\) m - k dt,0 <k<m. 



Proof. With the choice of a as in (|4.7|l and rt > m + 2 the function /i will have 
the following properties: 1) h is an even nonnegative entire function of exponential 
type one; 2) h belongs to Li(M) and its Li(R)-norm is 1; 3) the integral 

/OO 
h(t)\t\ m dt 
-OO 

is finite. The formulas (14. 8[) and (|4,9p imply the next formula 

/OO m /» OO 

h(t)j2 b i ej " iiL) fdt= / QityWfdt. 
-OO 7=1 J —oo 

where 

•<"-§^7)»( t 7)- 

Since the function /i(i) has exponential type one, every function h(tuj/j) has the 
type ui/j and because of this the function $(t) has exponential type u>. 
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Now we estimate the error of approximation of V^' m (f) to /. Since by (|4.8|) 

/oo 
h(t)A? f Jdt 
-OO 

we obtain 



E(f,co)<\\f-r^ m (f)\\ 



< 



hit) 



dt < 



h{t)Q m (/, t/uj) dt. 



By using the Lemma T4.2I we obtain 

I* oo 

E(f,u) < / h(t)n m (f,t/u)dt< 



n m - k (L k f, i/u) 



h(f)|t| fc (i + |t|) 



m — k 



dt < 



n m - k (L k f, i/u) , 



where the integral 

/oo 
h(t)\t\ k (i + \t\r-Ht 
-oo 

is finite by the choice of h. The inequality (14. 12)) is proved. 



□ 



Now we can formulate one of our main results about sparse approximation of 
functions in L 2 (G) . Namely, a combination of the Theorem 13.41 with the Theorem 
4.3l gives the following result about approximation of an / £ L 2 (G) by using samples 
of its orthogonal projection f u on PW W {L) or samples of the projection V£' m (f). 

In the following Theorem we assume that h is the function defined in (I4.6[) and 
(|4.7p and the operator p^' m i s defined in (I4.8I) - (|4.10[) . Let us also recall that in the 
Theorem 13.41 a subset of vertices S is such that every vertex v in 65 is connected 
to at least K (S) vertices in S, where 1 < K (S) < d(v). 

The next Theorem represents our result about sparse approximation on graphs. 



Corollary 4.1. If S d V(G) is the same as in the Theorem 
\2.22\) along with inequality 

K (S) 



and the condition 



u < 



hold, then there exist functions Q u € PW u {L),u £ S, and for any < k < 
to, fc,TO G N, there exists a constant Ck, m > such that for every f 6 L 2 (G) 



(4.14) 



ues 



< 



f-J2K m f(^u 



ues 



< 



Gk' 



'-n m - k (L k f, i/w) , 



where f u is the orthogonal projection of f on PW^ (L) . 

5. Lattice Z ra 



The Fourier transform T on L 2 (Z n ) is a unitary operator 

T : L 2 (7L n ) ^ L 2 (T n ,d£/ (2ir) n ) , 

where T" is the n-dimensional torus and g?£/(27t)™ is the normalized measure which 
is defined by the formula 

6, .»,£»)= £ f(k 1 ,k 2 ,...,k n )e^+^+-+^, 
(fci,fc 2 ,...,fc„)eZ" 
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where / G L 2 (Z"), (£1,62, ■■■,£n) € [~ 7r , 7T ) n ■ One can verify the following formula 

HLf W) = 4 (sin 2 I + sin 2 | + ... + sin 2 |) 
where / G L 2 (Z"), (£1, 6, 60 G [-tt.tt)**. 

Theorem 5.1. [20) The spectrum of the Laplace operator L on the lattice Z n is 
the set [0,4n]. A function f belongs to a space PW UJ {'L n ) for some < uj < An, if 
and only if the support of Tf is a subset f2 w of [— 7r,7r)™ on which 

8111 Y + sm y + - + y < 4- 

Let's consider for simplicity the case Z 2 = {(/ci, fc 2 )}, fci, fc 2 G Z. We will use 
notation 

5 = Z 2 \{(2fc 1; 2fc 2 )} fcifc2eZ 

for the set of vertices which is a compliment of the set of vertices {(2fc 1; 2fc 2 )}, ki,k 2 G 
Z. For this set the assumptions of the Sampling Theorem 13.41 will be satisfied with 
Kq(S) = 4 and we obtain the following fact. 

Theorem 5.2. If uj < 1, then 

1) the set S is a uniqueness set for functions in PW^iL); 

2) there exist functions Q u G PW W (L), u G S, such that for all f G PW / al (L) the 
following reconstruction formula holds 

(5.1) / = £/(«)©»• 

If 5 is the set {(fci, 2fc 2 )}, fci, fc 2 G Z, then the number k in the Theorem 13.41 is 
Kq(S) = 2 and we have a similar result for all spaces PW^fX) with cj < 1/2. 

If S is the set {(fci, 3/c 2 )}, fci, A: 2 G Z, then the number Kq(S) in the Theorem 
13.41 is Kq(S) — 1 and we have a result similar to the last Theorem for all spaces 
PW W {L) with uj < 1/4. 

To construct a projector 

P^ m :L 2 (Z 2 )^PM^(L) 

by the formula (|4.8|) one can use the following description of the Schrodinger's group 
of operators 

e itL j = -p-l f e -Ait{siv? ^-+sin 2 %-)^ j-y 

Now one can easily reformulate all statements of the previous section for the 
lattice Z 2 and each of the sets S above. 

Our results not only alow to reduce analysis on the lattice Z 2 to analysis on 
appropriate subgraph, but they also give estimates of possible losses of information 
which can occur after such reduction. 
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